Perturbation confusion in forward automatic differentiation of higher-order functions
نویسندگان
چکیده
منابع مشابه
Confusion of Tagged Perturbations in Forward Automatic Differentiation of Higher-Order Functions
Forward Automatic Differentiation (AD) is a technique for augmenting programs to both perform their original calculation and also compute its directional derivative. The essence of Forward AD is to attach a derivative value to each number, and propagate these through the computation. When derivatives are nested, the distinct derivative calculations, and their associated attached values, must be...
متن کاملAutomatic Testing of Higher Order Functions
This paper tackles a problem often overlooked in functional programming community: that of testing. Fully automatic test tools like Quickcheck and G∀ST can test first order functions successfully. Higher order functions, HOFs, are an essential and distinguishing part of functional languages. Testing HOFs automatically is still troublesome since it requires the generation of functions as test ar...
متن کاملPerturbation of higher-order singular values
The higher-order singular values for a tensor of order d are defined as the singular values of the d different matricizations associated with the multilinear rank. When d ≥ 3, the singular values are generally different for different matricizations but not completely independent. Characterizing the set of feasible singular values turns out to be difficult. In this work, we contribute to this qu...
متن کاملExtension of Higher Order Derivatives of Lyapunov Functions in Stability Analysis of Nonlinear Systems
The Lyapunov stability method is the most popular and applicable stability analysis tool of nonlinear dynamic systems. However, there are some bottlenecks in the Lyapunov method, such as need for negative definiteness of the Lyapunov function derivative in the direction of the system’s solutions. In this paper, we develop a new theorem to dispense the need for negative definite-ness of Lyapunov...
متن کاملForward-Mode Automatic Differentiation in Julia
We present ForwardDiff, a Julia package for forward-mode automatic differentiation (AD) featuring performance competitive with low-level languages like C++. Unlike recently developed AD tools in other popular high-level languages such as Python and MATLAB, ForwardDiff takes advantage of just-in-time (JIT) compilation to transparently recompile AD-unaware user code, enabling efficient support fo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Functional Programming
سال: 2019
ISSN: 0956-7968,1469-7653
DOI: 10.1017/s095679681900008x